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Abstract : We consider a process X = {Xt)tez belonging to a large class of causal models including 
AR(cxd), ARCH(oo), TARCH(oo),... models. We assume that the model depends on a parameter Oq G M"^ and 
consider the problem of testing for change in the parameter. Two statistics Qn"^ and qI^'' are constructed using 
quasi-likelihood estimator (QLME) of the parameter. Under the null hypothesis that there is no change, it is 
shown that each of these two statistics weakly converges to the supremum of the sum of the squares of inde- 
pendent Brownian bridges. Under the local alternative that there is one change, we show that the test statistic 
Qn — max(Ql^-', qI^-*) diverges to infinity. Some simulation results for AR(1), ARCH(l) and GARCH(1,1) 
models are reported to show the applicability and the performance of our procedure with comparisons to some 
other approaches. 

Keywords: Semi-parametric test; Change of parameters; Causal processes; Quasi-maximum likelihood 
estimator; Weak convergence. 

1 Introduction 

Many statistical data can be represented by models which may change over time, for instance hydraulic flow, 
climate data. Before any inference on these data, it is crucial to test whether a change has not occurred in the 
model. 

Since Page [23] in 1955, real advances have been done about tests for change detection. Horvath TT pro- 
posed a test for detecting a change in the parameter of autoregressive processes based on weighted supremum 
and iyp-functionals of the residual sums. The CUSUM statistic which was introduced by Brown et al. in 
1975, was modified by Inclan and Tiao [13] for testing change in variance of independent random variables. 
Their test has asymptotically correct size but the asymptotic power is unknown. Numerous works devoted to 
the CUSUM-type procedure, for instance Kim et al. [15] for testing change in parameters of GARCH(1,1), 
Kokoszka and Leipus [17] in the specific case of ARCH(cx)) or Aue et al. 1 for testing breaks in covariance. 

^ Supported by AUF (Agence Universitaire de la Francophonie) and Edulink ACP-EU project. 
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Kulperger and Yu [18j studied the high moment partial sum process based on residuals and applied it to 
residual CUSUM test in GARCH model. Horvath et al. [12] suggested to compute the ratio of the CUSUM 
functionals instead of the differences for testing change in the mean of a time scries. Berkes et al. [B] used a 
test based on approximate likelihood scores for testing parameter constancy in GARCH(p,q) models. These 
procedures are mostly developed in a parametric framework and their asymptotic powers are unknown. The 
present work is a new contribution to the challenging problem of test for change detection. 

In this paper, we consider a general class MxiM,/) of causal (non-anticipative) time series. Let M,f : 
—>■-/?? be measurable functions, {£,t)tez be a sequence of centered independent and identically distributed 
(iid) random variables called the innovations and satisfying var(^o) = o"^ and 8 a compact subset of M'^. Let 
T C Z, and for any 9 E Q, define 

Class AixiMg, fg): The process X — {Xt)ti£Z belongs to MxiMg, fg) if it satisfies the relation: 

Xt+i = Me{{Xt-,),eM)^t + /e((^t-0^ew) for aU t e T. (1) 

The existence and properties of this general class of affine processes were studied in Bardet and Wintenberger 
[2]. Numerous classical time series are included in Mz{M, /): for instance AR((>o), ARCH(oo), TARCH((X)), 
ARMA-GARCH or bilinear processes. 

Now, assume that a trajectory (Xi, • • • of X = {Xt)t£Z is observed and consider the following hy- 

pothesis: 

Ho : there exists 6*0 G 8 such that (Xi, ■ ■ ■ ,X„) belongs to the class A^{i_... _„}(Me„, /e^) ; 

K 

Hi : there exist K > 2, 6i,-- - ,9k G 8 such that {Xi,--- ,Ar„) belongs to MT''{Mg., fg.) where 
T^ = + 1, + 2, • • • , tj) with = to < <i < • • • < tx-i <tK = n . 

Thus, it is easy to see that under Hi the property of stationary is lost after the first change. This is not 
the case in many existing works (for instance Kouamo et al. [16j ) where the stationarity or the K-th order 
stationarity after the change is an essential assumption. 

In this paper we study a new test for change detection (see Bardet et al. [3] for the procedure of the 
estimation of the instants of change) . We consider a semi-parametric test statistic based on the QLME which 
is a modification of the statistic introduced by Lee et al. [l^. For k,k' € {2, • • • ,n — 1} (with k < k') let 
dn{Xk, ■ ■ ■ , Xk') be the QLME of the parameter computed on {k, • • • , k'}. The basic idea of our procedure 
is that : under Hq, 9n{Xi,--- ,Xk) and 9n{Xk+i,--- ,Xn) are close to 9n{Xi,--- ,Xn) and the distances 
||6'„(A:i, • • • ,Xk) - 9n{Xi, ■ ■ ■ ,Xn)\\ and ||6'„(A:fe+i, • • • ,Xn) - 9n{Xi, ■ ■ ■ ,X„)|| are not too large. Therefore, 
we show that the test statistic is finite under the null hypothesis and diverges to infinity under the alternative of 
one change. Simulation results compared to some other procedures show that our procedure is more powerful. 
In Section 2 we present assumptions, some examples and construct the test statistic. In Section 3 we give 
some asymptotic results. The empirical studies of AR(1), ARCH(l) and GARCII(1,1) are detailed in Section 
4 and the proofs of the main results are presented in Section 5. 
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2 Assumptions and test statistics 

2.1 Assumptions on the class of models M.T,{fe, Mq) 

Let 9 £ and AIq and fg be numerical functions such that for aU {xi)i^]N G , Mg(^{xi)i^]N) ^ and 
fe{{xi)ie]N) G IR- We wiU use the following norms: 

1. II • II applied to a vector denotes the Euclidean norm of the vector; 

2. for any compact set 8 C M"^ and for any g : 6 — !• Ff^ , ||.g||e — supggQ(||(7(0)||). 
Let "i/g — fg, Mg and i — Q, 1, 2, then for any compact set Q C JR'', define 

Assumption Ai(\E'g,0): Assume that ||9*^'e(O)/90'||e < oo and there exists a sequence of non-negative 

(k) °° (') 

real number {a\ (^'e,0))i>i such that ^ a)^ ('^g,Q) < oo satisfying 



fe=i 



de^ 80* 



^<Y.'^k\'^e,e)\xk'yk\ for all X, ye M"^ 



k=l 



In the sequel we refer to the particular case called "ARCH- type process" ii fg = and if the following as- 
sumption holds with hg := Mg : 

Assumption Ai{hg,Q): Assume that \\d^hg{0)/d6^\\Q < oo and there exists a sequence of non-negative real 

(k) °° (') 

number {a\ {hg,Q))i>i such as ^ aj^'{hg,Q) < oo satisfying 



k=l 



d'hg{x) d^hg{y) 



89' 89' 



< o^k (hg, e)\xl-yl\ for all X, ye M'^. 
k=i 

Then define the set: 

e(r) ■.= {eeQ, Ao{fe,{0}) and Ao(A/e, W) hold with ^ (/;,, 0) + (£; ICoD'/'' 51 (^^e^ ^) < U 



fe>i fc>i 

A;>1 



U{0ee, /e = and Ao{hg,{0})ho\d with{E\^on^^''J2'^k\f^e,0) < 1}. 



The Lipschitz-type hypothesis Ai{'i>g,Q) are classical when studying the existence of solutions of the general 
model. If 6* e 6(r) the existence of a unique causal, stationary and ergodic solution X = {Xt)t£Z & A^z(/e, Me) 
is assured (see [5]). The subset 0(r) is defined as a reunion to consider accurately general causal models and 
ARCH-type models simultaneously. 

The following assumptions are needed to study QLME property. 
Assumption D(0): 3h > such that inf (\hg(x)\) > h for all x E M 



IN 



Assumption Id(e): For all 9,9' £ 9^, 

(/e(Xo,X_i, •••) = /e' (^0,^-1, ••• ) and he{Xo,X^i, ■■■)= hg,{Xo,X^u ■■■) a.s.) 
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Assumption Var (8): For all 6' G 8, one of the families (-^^(Xq, • • • )) ^^^^^^ or (-^^(Xq, • • • )) 
is a.s. linearly independent. 

As in [5], we will make the convention that if Ai{Mg, 8) holds then a'"^\hg, 8) = and if Ai{hg, 8) holds 
then af{Mg, 8) = 0. Denote : 

Assumption K{fg, Mg,Q) : for i= 0, 1, 2, Ai(/e,8) and Ai{Mg,Q) (or Ai{hg,Q)) hold and there exists 
I > 2 such that afifg,e) + af{Mg, 8) + af{hg, 8) = 0(j~'), for i= 0, 1. 

Throughout the sequel, we will assume that the functions 6 n- Mg and 9 t-^ fg are twice continuously 
differentiable on 8. 



2.2 Examples 

1. AR((X)) models. 

Consider the AR(oo) process defined by : 

k>l 

with e 8, where 8 is a compact subset of J?'' such that J2k>i ll'/'fc(^)lle < 1- The process belongs to 
the class A4z{Mgt, fg*) where fg{xi, ■ ■ ■) = J2k>i 4>k{d)xk and Mg = 1 for all £ Q. Then Assumptions 
D(8) and Ao(/e,8) hold with /i = 1 and a^^\fg,Q) = ||(/)fe(6')||e. If there exists £ > 2 and (jyt twice 
differentiable such as Uk{0)\\e = Wk{0)\\e = \Wk{d)\\e = 0{k-^), then Assumptions K{fg,Mg,Q) 
holds. Moreover, if is a nondegenerate random variable, Id(8) and Var(8) hold. For any r > 1 such 
that £;|^or < oo, 8(r) = 8. 



2. GARCH(p,q) models. 

Consider the GARCH(p,q) process defined by : 

q p 

Xt = at^t , (jI = + X! °'*k^t-k + K<^t-k : ^ e Z 

k=l k=l 

with E (^o) = 1 and 9q (ag, • • • ,a*,(3l, - ■ ■ ,13*) g 8 where 8 is a compact subset of ]0, oo[x [0,oop+'' 
such that X]fe=i '^fe + /^fe 1 fo'' £ <d. Then there exists (see Bollerslev [8] or Nelson 

and Cao [22]) a nonnegative sequence (V'fc(6'o))fe>o such that cr^ = ?Ao(^o) + X]a;>i ^fc(^o)^t'^-fe '^ith 
V'o(fS) = "o/(l - This process belongs to a class Mz{Mg., fg.) where Me(xi,---) = 

\hpo{d) +^k>i''Pk{&)xk and fg = W9 € &. Assumptions D(8) holds with h — inf(Q!o). If there 
exists < po < 1 such that for any e 8, J2k=i '^k +J2k=i f^k < Po then the sequences (||'0fc(^)l|e)fc>ij 
(||'0fe(^)||e)fc>i and (||'i/'fc(^)lle)fc>i decay exponentially fast (see Berkes et al. [S]), thus Assumption 
K{fg, Mg,<d) holds. Moreover, if is a nondegenerate random variable, Id(8) and Var(8) hold. For 
r > 2 denote 

8(r) = {0 e 8 ; {E l^oH^/^ Y.""^ + J2 < 

k=i k=i 
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2.3 Test statistics 

Assume that a trajectory {Xi, ■ ■ ■ , Xn) is observed. It is clear that if {Xi, ■ ■ ■ , X„) € .„}(Me, fg), then 

for T C {1, • • • , n}, the conditional quasi-(log)likelihood computed on T is given by : 

t\2 



Ln{T,9) -i^gtW with = 1^1^^ + log (/i*) 



tGT " 

where fg = fg(^Xt-i, Xt-2 ■ ■ ■) , Mg — Mg[Xt-i, Xt-2 ■ ■ ■) and = Afg^. Therefore, we approximate the 
conditional log-likelihood with : 

L„(T,0):=-l^g,(0) where q,{e) := ^^^^j/^ + log (hi) 
with/* -/(,(Xt_i,...,Xi,0,0,---), M* = M(,(Xt_i,...,Xi,0,0,---) and hi = (M*)^. 

For T C {I,-- - ,n}, define the estimator 9n{T) := argmax(L„(T, 6')). Moreover, for 1 < fc < n, denote 
Tk^{l,--- ,k} and = {fc + 1, • • • , n}. 

Now, define 

^ ,rj., _ 1 ^ fdqt^rm)\ f dqt(dn{T)) y ,Btr^. 2 ^ a^L„(r,0„(T)) 

For fc = l,---,n— 1, denote : 

Let (wn)new be a sequence satisfying u„ — > oo and Vn/n — > (as n oo). Denote n„ ~ ti — w„] n IN and 
define the statistics: 

qI') := maxQ^'), where Q|,'), := — (^«(Tfe) - ^„(r„))'Sn,fe(^„(Tfc) - ^n(T„)); 

qL'^ := maxgi'l. where g^'^. il^^-^ (^„(Tfc) - ^„(T„))'E„,fe (^„(rfe) - ^„(r„)); 

i(i) ;i(2) 



„ := max(Q„ , Qn ) which is the test statistic. 



Remark 2.1 A'^oie that, the choice of (w„) is crucial in practice. We evaluated the procedure with Vn = 
[logrt], [(logn)^], [(logn)'^] and recommend to use f„ — [(logrt)^] for linear model and u„ — [(logn)"'^/^] for 
GARCH-type model. 

Lee and Song 2T constructed a test for detecting changes in parameters of ARMA-GARCH models. Their 
test statistic uses a matrix E„ which depends on the estimator 0n(T„). Under the null hypothesis (the pa- 
rameter ^0 does not change), I]„ is a consistent estimator oi FG~^F where G = E [{dqQ{9fi) / d6){dqa{9o) / 89)'] 
and F — E [d'^qQ{9o) / d9d9']. Under the alternative, the model depends on several parameters and 6'„(T„) may 
not be a consistent estimator of one of them. Therefore, the convergence of the matrix S]„ is not assured. 
Thus, the asymptotic behavior of the test statistic may be very difficult to study. To solve this problem, we 
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introduce the family of matrices {Sri.fc, k e !!„}. It is easy to see that under the null hypothesis, any sequence 
i^n,k„)n>i,k„Gnn IS consistcut. We show (see proof of Theorem 13. 2p that under the local alternative where 
there is one change in the model, there exists a sequence (E„_fe* )„>i^fc. gn„ which converges. 

3 Asymptotic results 

3.1 Asymptotic under the null hypothesis 

o 

Theorem 3.1 Assume D{Q), Id(Q), Var and K(fe, Mg,Q). Under the null hypothesis Hq, if 9q G S(4), 
then for j = 1, 2, 

g(f) ^ sup \\Wdir)f 

n-^oo 0<T<1 

where Wd is a d-dimensional Brownian bridge. 

For any a G (0, 1), let Ca denote the (1 — Q!/2)-quantile of the distribution of sup ||T4^d(r)p. Then, the 

0<r<l 

following corollary is a direct application of Theorem 13.11 
Corollary 3.1 Under assumptions of Theorem \3.1\ : 

Va G (0, 1) limsup P(Q„ > C„) < a. 

Remark 3.1 Quantile values of the distribution of sup ||W(z(r)|p are known (see for instance Kiejjer 

0<T<1 

forde {I,-- - ,5} or Lee et al. fl^ for d e {1, ■ ■ ■ ,10};. 

Theorem 13. II and CoroUarv 13.11 implv that a large value of Qn means there is a change in the model. At a 
nominal level a, the critical region of the test is {Qn > Ca)- 

Figure 1 is an illustration of the test procedure for AR(1) process. At a level a = 0.05, for d — 1, Ca — 2.20. 
Figure 1 a-) and b-) show that, the values of Qn \ and Qn \ are all below the red line which represents the 
limit of the critical region. Figure 1 c-) and d-) show that \ and Qn \ are larger and increase around the 
point where the change occurs. 

As it can be observed on the Figure 1 and Figure 2 , the statistics Qn^ and Qn^ are not clearly equal. 
Figure 2 shows the typical example for ARCH{1) with one change where Qn^ < Ca and Qn^ > Ca- In 
general, we don't know if under the alternative hypothesis each of statistics Qn^ and "* take large values. 
But, under the local alternative of one change, the maximum of these two statistics diverges to infinity (see 
Theorem 13. 2p . This is the reason why we define the critical region as {max((5n \ Qn ■*) > Ca}- 

3.2 The asymptotic under a local alternative 

In this subsection, we consider a local alternative that there is one change in the model. More precisely, define 

H^^""^ ■- there exist t* e (0, 1) and 91,6; eQ with 6^ ^ 0^ such that ATi, • • • X^^^r'] e >'T[„,., {Mg.Jei) 
and X^nT']+i, ■■■ ,Xne A^T[„,., (^'% ' fe^)- 
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Theorem 3.2 Assume D{e), Id(Q), Var and K(fe,Mg,e). Under h[^'"'\ if 61,9^ G 9(4), the 



Remark 3.2 1-) Theorem ] 3. 2\ shows that the test with the local alternative Hf°'^'^ is consistent in power. 
2-) This procedure can also he used to test multiple changes using ICSS type algorithm developed by Incldn and 
Tiao im. 



a-) Qn i; for AR(1) with no change 



b-) qJ,^ for AR(1 ) with no change 
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Figure 1 : Typical realization of the statistics Q^^]. and Q':^\ for 1000 sample of AR(1) with u„ = [logn]. a-) 
and b-) are the case of AR(1) where parameter 0i ~ 0.3 remains constant, c-) and d-) are the case of AR(1) 
with parameter t/fi =0.3 changing to 0.5 at k* = 400. 
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a-) cf^l for ARCH(1) with one change at k* = 400 



b-) Cf-^l for ARCH(1 ) with one change at k* = 400 




1 r 

800 1000 









V 



1 I I I I r 

200 400 600 800 1000 
Time 



Figure 2 : Typical realization of the statistics Q^jl\ and Q^^'f. for 1000 sample of ARCH(l) with v„ — [(log n)^ 
a-) and b-) are the case of ARCH(l) with parameter 6i = (1, 0.3) changing to (1, 0.15) at k* = 400. 



l(2) 



4 Some simulations results 

In this section, we evaluate the performance of the procedure through empirical study. We compare our 
results with those obtained by Kouamo et al. [16] , Lee and Na [20] and the results obtained from the residual 
CUSUM test by using the statistics defined by Kulperger and Yu [18]. For a sample size n, Q„ is computed 
with Vn = [(Inn)^] for AR model and u„ = [(Inn)^/^] for GARCH model and is compared to the critical value 
of the test. In the following models, (^t)tgz are iid standard Gaussian random variables. 

4.1 Test for parameter change in AR(p) models 

p 

Let us consider a AR(p) process : Xt — 4>*k^t-k + with p G IN* . The true parameter of the model is de- 

fc=i 

noted by = (0^, • • • , 0;) e 6 where Q = {9 = ■ ■ ,4,^) £ EP /j2\M< !}• Since Me = 1, e(r) = 9 

i=l 

^ P 2 

for any r > 1. Assume (Xi,-- - ,X„) is observed, we have for any 6* e 8, qt{S) = [Xt — ^ (pk^t-k) , 

fe=i 

= -2{Xt - f: M-k) ■ (Xt_i,Xt_2, • • • ,Xt-p) and for l<i,j<n = 2Xt-,Xt-j. 

Cf fc=i o(piO(pj 



We consider a AR(1) process with one parameter. At level a = 0.05, the critical value is Cq ~ 2.20. For 
n — 1024, 2048, 4096 ; we generate a sample {Xi, • • • , X„) in the following situations : (i) there is no change 
and the parameter of the model is = 0.9 and (ii) there is one change and the parameter 6*0 = 0.9 changes to 
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01 — 0.5 at n/2. The following table indicates the proportion of the number of rejections of the null hypothesis 
out of 100 repetitions. 





n = 1024 


n = 2048 


n = 4096 


Empirical levels 
Empirical powers when 6i = 0.5 


0.080 (0.134 ; 0.092) 
0.980 (0.590 ; 0.530) 


0.070 (0.100 ; 0.062) 
0.990 (0.720 ; 0.680) 


0.050 (0.082 ; 0.040) 
0.990 (0.810 ; 0.790) 



Table 1: Empirical levels and powers at nominal level 0.05 of the test for parameter change in AR(1) model. The empirical 
levels are computed when 6o = 0.9 ; the empirical powers are computed when changes to Oi = 0.5 at n/2. Figures in brackets 
are the results obtained by Kouamo et al. 1161 at the scale J=4 with KSM and CVM statistic in wavelet domain. 



Table [T] shows that the empirical level of the test decreases as n increases and equals to 0.05 when n = 
4096. These levels are close to those obtained by Kouamo et al. with CVM (Cramer- Von Mises) test statistic. 
The results obtained with our test statistic Q„ are clearly more accurate. 

4.2 Test for parameter change in GARCH(1,1) models 

Consider the GARCH(1,1) model defined by: 

yt G Z, Xt = (JtCt with cr^ = QfQ + a*iX^_i + I3*a1_i 

with = [al,a\,[}l) G 9 c]0, oo[x [0, oop and satisfying a\ + PI < 1. The ARCH(oo) representation is 

a'^ = ay {I - 131) + alJ2 iPi)''^^ For any 6* G 9 and i = 2, • • • , n , we have 

fc>i 

t 

hl = ao/{l-(3,) + aiXl,+aiJ2l3t'xlk and qt{0) ^ / ^ + iog(hl) . 

fe=2 

Therefore, it follows that ^ = J-(l - with dhl/da, = X^ + E ^t'^l, 

dhl/dao = 1/(1 - /3i), and dhl/d(3i = ao/{l - Pif + aiX^.^ + ai ^ (fc - l)/3^2^2_^_ 

fc=3 

Let 9 = (ao,ai,/3i) = {Oi, 02,03) G 9, for 1 < i,j < 3, we have 

with d'^h^/dal = 0, d'^ly daedal = 0, d^hl/dal = 0, d^hl/daidPi = X'^_^ + E (^ - 1)PI'^X^_^, 

k=3 

d%/daodl3i = 1/(1 - /3i)2 and dhl/dl3f = 2ao/(l - /3i)^ + '2aiXf_3 + ai (fc - l){k ~ 2)(3'[-^ Xf^^. 

k=i 

1. Case of ARCH(l). Assume /3i = and 9 = (ao,ai). At level a = 0.05, the critical value is Cq ~ 3.02. 
For n = 500,800,1000 ; we generate a sample (A"i,--- ,X„) in the following situations : (i) there is 
no change, the parameter of the model is 0o ~ (1,0.3) and (ii) there is one change, the parameter 
6*0 = (1,0.3) changes to two different values of 9i = (0.5,0.3) and 9i = (0.5,0.6) at n/2. The following 
table indicates the proportion of the number of rejections of the null hypothesis out of 500 repetitions. 



10 



Testing for parameter constancy in general causal time series models 





n = 500 


n = 800 


n = 1000 


Empirical levels 
Empirical powers when 6i — (0.5,0.3) 
Empirical powers when 6i — (0.5,0.6) 


0.068 (0.088) 
0.948 (0.922) 
0.876 (0.498) 


0.048 (0.080) 
0.972 (0.987) 
0.976 (0.589) 


0.036 (0.074) 
0.998 (0.995) 
0.984 (0.606) 



Table 2: Empirical levels and powers at nominal level 0.05 of the test for parameter change in ARCH(l) model. The empirical 
levels are computed when do = (1,0.3) ; the empirical powers are computed when changes to 0i at n/2. Figures in brackets 
are the results obtained by Lee and Na 1201 . 

2. Case of GARCH(1,1). Now 6 = (ao,ai,/3i). At level a = 0.05, the critical value is ^ 3.47. For 
n = 500,1000,1500 ; we generate a sample {Xi,--- ,Xn) in the following situations : (i) there is no 
change, the parameter of the model is 9q — (1,0.4,0.1) and (ii) there is one change, the parameter 
00 = (1,0.4,0.1) changes two different values of 6*1 (0.7,0.4,0.1) and Oi = (1,0.4,0.3) at n/2. The 
following table indicates the proportion of the number of rejections of the null hypothesis out of 500 
repetitions. 





n = 500 


n = 1000 


n = 1500 


Empirical levels 
Empirical powers when 6i = (0.7, 0.4, 0.1) 
Empirical powers when 6*1 — (1,0.4,0.3) 


0.100 (0.030) 
0.498 (0.334) 
0.654 (0.404) 


0.078 (0.032) 
0.752 (0.658) 
0.968 (0.772) 


0.052 (0.042) 
0.934 (0.848) 
0.976 (0.922) 



Table 3: Empirical levels and powers at nominal level 0.05 of test the for parameter change in GARCH{1,1) model. The empirical 
levels are computed when 6o = (1, 0.4, 0.1) ; the empirical powers are computed when 6o changes to 9i at n/2. Figures in brackets 
are the results of the residual CUSUM test using CUSUM^'^) statistic defined by Kulperger and Yu [18]. 

Table [5] and Table [3] show that the empirical level of the test decreases and the empirical power increases 
as n increases. For ARCH model, we can see that the empirical level is less than 0.05 when n = 800. It is not 
very surprising because the asymptotic size of the test is less than a — 0.05. This is not the case for GARCH 
model. It is explained by the fact that the application of the procedure to GARCH model requires ARCH(oo) 
representation. Thus, the information contained in all the past of the process is not used because it is not 
observed. In Table [H figures in brackets are the results obtained by Lee and Na [20] using the CUSUM test 
based on conditional least-squares estimator. In Table [31 figures in brackets are the results of the residual 
CUSUM test that we obtained by using CUSUM'-^^ statistic studied by Kulperger and Yu [18]. Once again, 
our test statistic Q„ provides best results. 

5 Proofs of the main results 

Let {ipn)n Bind (r„)„ be sequences of random variables. Throughout this section, we use the notation ^„ — 
op{rn) to mean : for all e > 0, PdV'nl > ^knl) — > as n — > oo. Write ipn — Op{rn) to mean : for all £ > 0, 
there exists C > such that Pdi/'nl > C'knl) < £ for n large enough. 
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5.1 Some preliminary results 

First, let us prove useful technical lemmas. 

Under the null hypothesis Hq the observations (Xi, ■ ■ ■ ,Xn) belong in the class A4[i ... n}{Meg,feg), de- 



[dqo{9o)dqo{do)' 



fine the matrix G := E 

I 89 do 
assumption Var, F is a non-singular matrix (see [2]). 



( where ' denotes the transpose) and F := E 



8989' 



Under 



Lemma 5.1 Assume the functions i— > AIq and 9 fg are 2-times continuously differentiable on O. Under 
the null hypothesis D{Q) and Var, G is a symmetric, positive definite matrix. 

Proof. It is clear that G is symmetric. Moreover, ioi I < i < d, we have : 



dqoi9o) 
89i 



= -2- 



Oo 



89i 89i /lO 89i 



Thus, using independence of a-nd ^-i, ^-2, • • • we obtain 



E 



qo{9o)' dqoi9o) 



89 



89 



= AE 



1 a/" 



h^a 89 89 



1 8hl'8hl 



(/ig )2 89 89 



(2) 



Since E'^q = 1, it is easy to see that E - If) > 0. 

Under Var, one of the two matrix of the right-hand side of relation ([2|) is positive definite and the other is 
semi-positive definite. Thus, G is positive definite. ■ 



Now, recall that F := E 



d^qoi9o) 



8989' 



Let T C {1, • • • , n}. For any 6* G 9 and i = 1, • • • , d, by Taylor 



expansion of dLn{T,9o)/89i, there exist 9n.i G [^'o,^'] such that: 

8LniT,9) _ 8LniT,9o) , 8^L„{TX.,) , 



89^ 



89^ 



8989^ 



(3) 



where [a,b] - {Aa + (1 - X)b ; A e [0,1]}. Denote i^„(T,0) = -2{—^^^^^^)^^^^^. Then, ® 
implies. 



Card{T)Fn{T, 9){9 ^ 9^) 



^card{T) 8989, 
,8K{T,9) 8K{T,9o)s 



89 



89 



(4) 



(5) 



Similarly, for any 9 Q we can find a matrix Fn (T, 9) such that 

CardiT)F,.iT,9)i9 - 9,) = -2(^5^ - ^"^'f/'^ )- 

With 9 = 9„{T) in © and using the fact that 8L„(T,9„{T))/89 = (because 9n{T) is a local extremum of 
L„(r, •)), it comes 

,<9£„(T, 9o) 



Card{T)Fn{T,9n{T)){9n{T) - 9o) = 2- 



(6) 



Remark 5.1 //Card(T) — > 00 and 9 = 9{n) — > 9a, then FniT,9) ^ F and Fn{T,9) 
and In particular, if Card{T) — > 00 , then Fn{T, 9 n{T)) ^ F andFn{T,9n{T)) 



n— J-OO 

a.s. 



F (see 
F. 
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Lemma 5.2 Under assumptions of Theorem \3.1\ 

^ max \\k{KiTkX{Tk)) ~ F)(9nin) - 9o)\\ = op{l). 

Proof. For k €E n„, we know that Vk{dn{Tk)) - 6*0) converges in distribution to the Gaussian law as 

n — > 00 (see Theorem 2 of 2). Therefore, max \\\/k(9n(Tk) — Oq)\\ = Op(l). Remark 15.11 imphes that 

' ' fcen„ II II 

max ||F„(rfc,^„(rfc)) - Fll = o(l) a.s. Thus 
keu„ II II 

^ max \\k{Fn{TkA{Tk)) ~ F){en{Tk) ~ eo)\\ < max \\Fn{TkX{Tk)) - F\\ x max \\Vk(en{Tk) - 9n)\\ 
i/n fc6n„ II II feGn„ n n fcen„ n n 

= o(l)Op(l) a.s. 

-op(l). 



Under assumptions of Theorem I3.1[ the matrix G is invertible. Denote S = FG ^F 

Qll^ := maxQ^^ ^^ere q':^1 := — (^„(Tfc) - ^„(T„))'l](a„(Tfc) - ^„(r„)) and 
fcGn„ ' ■ n 

Q(f) := maxQ^'^ where qI^^ := ili— ^ (0:„(Tfe) - 0„(T„))'s(^„(Tfc) - ^„(r„)). 
Lemma 5.3 Under assumptions of Theorem \3.1\ 



fcen„ 



tl!k~Q'i!^=op{^ for j^l,2. 



Proof. The proof is provided for j = 1, proceed similarly for j ~ 2. For any k G n„, we have 

< 2— (||?„(rfe) - Oof + \\0n{Tn) - Oo\\^)\\^n,k - S]] 

n 

< 2{\\Vki0n{Tk) - 0o)f + \\V^i0n{Tn) - ^^o)||')||S„,fe - Ell. (7) 

Since k £ n„, k,n — k — > 00 as n — !• 00. Therefore, \/fc(?„(Tfe)-0o) = Op(1) as n — > 00, ^/n{On{Tn) — do) — 
Op(l), F„(rfe) ^ F,F„{Tk) ^ F,Gn{Tk) ^ G and G„(n.) ^ G which is invertible. Thus, for 

n— >oo n— J-cxD n— ^00 n— >-oo 

n large enough, Gn{Tk) and Gn{Tk) are invertible. It follows that as n — > oo, 

||S„,fc - S|| = \\-FniTk)GniTk)-^Fn{Tk) + ^^^FniTk)GniTk)'^ F^iTk) - FG-'f\\ 

= \\-{-F,,{Tk)Gn{Tk)-'h{Tk) - FG-'F) + !i_^(F„(Tfc)G„(rfe)-iF„(Tfc) - FG-^F)\\ 
< ||F„(Tfc)G„(Tfe)-iF„(Tfe) - FG-iF|| + ||F„(Tfe)G„(Tfe)-iF„(Tfe) - FG-'F\\ = o(l) a.s. 

Therefore, implies max {Q^^I - Q^^]^| = op(l). ■ 
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Lemma 5.4 Under assumptions of Theorem \3.1\ 

where Wq is a d- dimensional Gaussian process with zero mean and covariance matrix min{T, s)G. 

Proof. Recall that —2 ^---^ = 2^ — — — . Denote Ft = cr(A(-i, • • • ). Since X is stationary and 

Ou t—i Ou 

ergodic, it is the same for the process (— ^)tez- Moreover, ( '^gg'^^ ''^*) ^ square integrable martingale 
difference process (see (Ij) with covariance matrix G. Then, the result follow by using Theorem 23.1 Billingsley 
(1968) (see [7] page 206). ■ 



Lemma 5.5 Under assumptions of Theorem \8.1\ 

^^_,,,.aL„(rt „^o) _ MaL„(r„,^o)x ^ ^n d{[^mr'^) 

\ oO n oO J 

where Wd is a d- dimensional Brownian bridge. 

Proof. By Lemma it comes 

-2 fdLr,{T[„r],Oo) [nr]5L„(r„,0o)\ v 



de n do 



Wg{t)-tWg{1) in DilQ.MM^). 



Since the covariance matrix of the process {Wg{t) — rWcii^), < r < 1} is (min(T, s) — ts)G, the covariance 
matrix of the process {G^^^^{WGiT)~TWG{^)), < r < 1} is (min(T, s) — Ts)Id (where Id is the d-dimensional 
identity matrix). Therefore, the process is equal (in distribution) to a d-dimensional Brownian bridge and the 
result follows. ■ 



Lemma 5.6 Under assumptions of Theorem \3.1\ 

-^^_,^, a£„(rt ] 0„(r„)) ^ ^n D{%1],R''). 

Proof. From [2], we have -^11 ^ "l/,"' ^ — ^'^"IT"' ^ \\n ~ ^p{^)- This implies, 

\/n ou ou ^ 

T^.^S"^^ 9^lle = "^(^)- 

Let fc e n„. Applying (g]) with T and 6* = ?„(r„), we have 



kFn(Tk,0n{Tn))i0niTn) - 9o) = -2 



80 80 
By plugging it in ([S]), we have 

—r= max — — h -fcF„(TA;, 6'„(r„))(6'„(T„) - 6*0) = op(l). (9) 

y/n feen,i " 80 80 2 " 
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But, by Reinark l5.ll it comes that 
1 

— = ma; 

-/n ken 



max ||fc(F„(Tfc,^„(T„))-F„(T„,^„(T„)))(^„(r„)-0o)|| 



< ^ max ||fc(F„(rfc,0„(T„))-F„(T„,^„(r„)))|| x || V^(^„(T„) - 0o)|| 

= o(l)Cip(l) a.s. 
-op(l). 



Thus, ([9]) becomes 



Applying (HD with T = Tn ,9 = ^„(r„), and using (l/0i)(aL„(T„, ?„(r„))/a0) = op(l) (see [1]), it fohows 

F^iTnXiT^mOjT,,) - 0o) = l^lM^lM + op(^). (11) 

n oO \/n 

Therefore, pUt becomes 

1 || aL„(rfc,g„(T„)) 9L„(Tfc,go) fc 9L„(r„,go) || 
^ TTa ^ HZ = °pV)- (12) 

Now, let < T < 1, for large value of n, we have [rn] € n„; write 

2 „_i/2 t^^ri(T[„^], (r„)) ^ -2 r 9£„(r[„^], 0n(Tn)) ^ 9£„(T[„t] , gp) ^ [nr] 9L„(T„,go) , 



96* ^90 71 96* ^ 

9L„(T[„,],^?o) [nr]9L„(T„,(?o)^ 



^96' n do 

and the result follows by using (fT2|) and Lemma [531 



5.2 Proof of Theorem [SH] and Theorem [3H 
Proof of Theorem [O . 

We give the proof for j = 1, proceed similarly for j = 2. By Lemma 15.31 Theorem 13.11 is established if 
q1^^ sup \\Wd{T)f. Using (HI), © with T = and Lemma O it follows 

n-+oo 0<r<l 

1 II 9L„(Tfc,6'o) 1,t;,/2-^t.n /) \|| 1 udLn{Tk,9o) 1 , ci ^ /i ^|| , /i\ 

~r F^^^ 7ui {9n{Tk) - Oo)\\ = max — -kF 6'„(Tfe) - 6'o) + op 1 

= ^ max ||ifcF„(rfe,^„(rfe))(^„(r„) - 0o) - \kF (dniTk) - eo)\\ + op(l) 

= ^ max ||ifc(F„(Tfc,?„(rfe))-F)(0„(T„)-0o)|| +op(l) = op(l). (13) 
\/n feen„ "2 " 
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Using (fT^ and[T21 we have 

1 ndLn{Tk,On{Tn)) ^ i rp m /rr, \ n /rj^ \\\ 

~r ,™?r^ Im o^-^ 71- - fi'n T„)) 



1 iiaUTfcA) fc a£„(T„,go) l,p.^.^. fl/T^AMM n> 

^ max \\kF - 9o) - ^^M^^ _ }.kF [Un) - ^„(r„))|| + op{l) 

1 /3 \ fc 9L„(T„, 6*0) II , , 

= 7^ II - ^ n — — II + 

< V^WI-F (^„(T„) - 0o) - - ^^"^!;'^°^ || + op(l). (14) 
"2 n oO " 



Note that 



||v^(F-F„(T„,&„(r„))) (?„(T„)-0o)|| < ||F-F„(r„,^„(T„))|| || V^(^„(T„) - 0o)|| 

= o(l)Op(l) a.s. 

= Op(l). 

By plugging it in and applying with T — Tn and ^^ = 9n{Tn), we have 

1 max||^^:^ii%^^i^^ _ 1^^ ^^^^^^^ ^ ^^^^^^^11 ^ 1 J^„(T„,^„(T„))(^„(T„) - 9o) i ^^^Ili^ilM 1 1 
ynfcen„" at' 2 " "2 n o9 

+ op(l). (15) 

Therefore, using ([TT]), implies 

Vn^feen„" aw 2 " 

Now, let < T < 1, for large value of n, we have [rn] e n„; write 

^^_,,, aL„(Tt ,?„(T„)) ^ _ Mc-V2^(^„(r[„.,) - ^„(T„)) 



2G-1/2 1 



/7i 



^-^^ ^inT]F{9n{T[,„]) - 9n{Tn)) 



Therefore, using (|16p we have 



\/n at/ 



and the result follows by using Lemma [5.61 



Proof of Theorem [SH . 

Let T* e (0, 1) the true value of break. Denote k* = [nr*]. For n large enough , k* e n„. Therefore, we have 
for j = 1,2, glf^ = maxQlf]. > Thus, it follows that 

g„ = max(Qli) , gi^) ) > max(Qi^^ , Q% ). (17) 
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Since ^1,^2 S 6 (4) , it comes from [5] that the model M z (Mg* , /g. ) and M z (Mg* , fg* ) have a 4-order station- 
ary solution which we denote {Xtj)t^z for j = 1, 2. 

For J = 1, 2 denote for any t € Z, 9*^(0) := {Xt,, ~ fg' )y {h'g' ) +log{h'^' ) with f'' := Xt_2j, • ■ 

/i*'^' := (M*'^)2 where M*/ := Mg{Xt-i,j, Xt-2,j, ■ ■ ■)■ Also denote for j = 1,2 

For j — 1,2, Lemma 15.11 implies that the matrix G^-'^ is symmetric positive definite and Corollary 5.1 of 
[3] implies Gn(Tk^) ^ G^^^ and G„(Tfe.) ^ G^^). Lemma 4 of [2] implies F„(rfe.) ^ F^^'> and 

FniTk-) ^ Therefore, it follows that 



^n,k* '■— ^Fn{Tk')Gn[Tk-) (Tfc. ) 1 ^^^^g^^ ^ j,^^ + ^ F„ (Tfc* )G„ (Tfc. ) "^-F'n(Tfe')ldct(G„(Tfc.))#0 



n — k* ^ , — 
n 

+ (1 - t*)f(2)(g(^))-i^^(2). (18) 



Denote E = t*F(i)(G(i))-1f(i) + (1 - T*)i^(2)((^(2))-i^(2)_ jg gg^gy ggg jg symmetric positive 

definite matrix. 

For all p > and 9 £ Q, denote Bo{0, p) (rep. Bc{0, p) ) the open (resp. closed) ball centered at 9 of radius p 
in 9. i.e. 

Bo{9,p) = {x e e ; 116* < p) and 5^(0, p) = {x e 6 ; ||6l- a;|l < p). 
For A C 6, we denote A"" = {x e Q ; x ^ A}. 

Since 91 ^ 9^ and 6'5', 6*2 G 6(4) C 8, then there exist pi > and P2 > such as 50(6*^,^1) f] Bo{9l, P2) ^ ^. 
For all n G iV, denote 

(5^-'") = inf ((x - 2/)'E„.fc. (x ~ v)) for j = 1, 2. 

Also denote S'^^^ = inf ((x — w)'E(x — w)). It is easy to see that (5*^^^ > for 7 = 1, 2. 

Using (fT5|) . we have 

jO) ^ jO) for j = i,2. (19) 

n— >-oo 

From [2] and [3], we have 9„{Tk') ^ 9^ and 9„{Tk-) ^ 9^ Therefore, for n large enough, ?„(Tfc.) e 

n— ^00 n— )-oo 

So(^t,Pi/2) and 6'„(Tfc. ) G 50(6*27 P2/2). Thus, two situations may occur 



• if 0„(r„) e Boi9*2,p2) i.e. 0n(T„) G 5^(0^, pi) then (0„(Tfe.) - ^„(r„))'E„,fc.(^„(Tfc.) - 0„(r„)) > <5^^ 
Therefore, 

QSI- := ^(^"(Tfc.) - &„(r„))'S„,fc.(^„(Tfc.) - 9n{Tn)) > ^S^p ~ n(T*)25,«. 

• else 0„(r„) G B„=(02*,P2) and (?„(Tfe.) - ^„(r„))'S„,fe.(^„(Tfe.) - 0„(T„)) > Therefore, 

QS- = i!i_^(0„(T,*) ~ ^n(r„))'aa*(^«(n.O - ^«(r„) > ^""'f^' s^^^ n(l - r*)2<5i^). 

In all cases, we have g„ > max(Q^^)^.. , Q^^)^.) > min(7i(T*)2,5i^\ n(l - T*)^6i?). 
Thus the result follows by using ([TO)) . 



(1) 
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